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DETAILED ACTION 

In response to an Amendment received on January 13, 2004. This action is non- final. 
Claims 1-40 are pending in this application. Claims 1,6, 15, 18, 28 and 31 are independent 
claims. 

The present title of the invention is "Method and System for Digitizing Freehand Graphics with 
User-Selected Properties". _ 
The Group Art Unit of the Examiner case is now 2676. Please use the proper Art Unit number to 
help us serve you better. 

Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 35 1(a) shall have the effects for purposes of this 
subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

2. Claims 6 and 31-33 are rejected under 35 U.S.C. 102(e) as being anticipated by Raviv et 
al. (US 6,061,052; refer to as Raviv herein). 

3. Regarding clam 6, Raviv discloses a display pointing device comprising: 

A base enabling the digitization of a freehand graphic (lines 1-8 of abstract and lines 28- 
35 of column 5 and Fig. 12; while claim recites freehand graphic, the term is broad enough to 
include the drawing method disclosed by Raviv. Display screen corresponds to base); 
A surface; on the surface, a position-coding pattern detectable by an optical sensor; a first area of 
the surface; a second area of the surface visually distinct from the first area (lines 7-14 of column 
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3. lines 40-67 of column 4 and lines 1-1 1 of column 5 and Fig. 10-1 1; it is noted that the coding 
pattern on the screen (surface) sensed by the optical sensor on the pointing device is used to 
determine position. Also, while claim recites first and second areas, since claim does not specify 
any limitation on the areas, each numerical symbol region in Fig. 10 can represent an individual 
area. And each numerical symbol region is visually distinct from each other). 

4. Regarding claim 3 1 , statements presented above, with respect to claim 6 are incorporated 
herein. Furthermore, Raviv discloses a display pointing device comprising: 

A second area of the surface having no overlap with the first area; the second area having 
a plurality of sub-areas; at least ohe of the plurality of sub-areas having a visual indicator aving 
representing specific information a user can submit to a computer system by moving a drawing 
device over the at least one of the plurality of sub-areas (lines 40-67 of column 4 and lines 1-35 
of column 5 and Fig. 9-10; numerical regions correspond to first area and non-numerical regions 
correspond to second area where they do not overlaop and each with sub- areas. And each sub- 
area has its visual indicator, such as "4" or which can be submitted to the system by using 
the optical sensor on the pointing device, which can also be a drawing device). 

5. Regarding claims 32 and 33, Raviv discloses a display pointing device comprising: 
The visual indicator comprises at least one alphanumeric symbol and the plurality of 

sub-areas are visually separated (Fig. 9-10). 

Claim Rejections - 35 USC §103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
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having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

7. Claims 1-3, 5, 15-24 and 26-30 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Raviv et al. (US 6,061,052; refer to as Raviv herein) in view of More et al. (US 5,194,852; 
refer to as More herein). 

8. Regarding claim 1, Raviv discloses a display pointing device comprising: 

_A system_for_digitizing-a freehand graphic-(-lines 4 -8 of abstract and lines 28-35 of — 
column 5 and Fig. 12; while claim recites freehand graphic, the term is broad enough to include 
the drawing method disclosed by Raviv); 

A base including: a surface; on the surface, a position-coding pattern; a first area of the 
surface; and a second area of the surface (lines 40-67 of column 4 and lines 1-1 1 of column 5 and 
Fig. 10-11; it is noted that the coding pattern on the screen (surface) is used to determine 
position. Also, while claim recites first and second areas, since claim does not specify any 
limitation on the areas, each numerical symbol region in Fig. 10 can represent an individual 
area); 

A drawing device having an optical sensor functional to detect a position in the position- 
coding pattern (lines 7-14 and 30-40 of column 3 and lines 28-35 of column 5 and Fig. 1-3 and 
12); 

A microprocessor adapted to perform the following actions (lines 45-49 of column 1 and 
Fig. 1; while claim recites microprocessor, it is clear that the processing circuitry includes a 
processor to process the output from the optical sensor to identify the location of the pointing 
device): 



Application/Control Number: 09/8 12,882 Page 5 

Art Unit: 2676 

Determining if the position detected by the optical sensor is in the first area or the second 
area (lines 40-67 of column 4 and lines 1-11 of column 5 and Fig. 10-11; the numerical and non- 
numerical symbol regions correspond to first and second areas and the position on which area is 
determined by the coding pattern sensed by the optical sensor); 

Raviv does not disclose if the position is in the first area of the surface, then interpreting 
the position as a point in the freehand graphic; and if the position is in the second area of the 
surface, then interpreting the position as a selection of a property for the freehand graphic. More 
discloses a portable interactive electro-optic data input/output display device utilizing the method 
(lines 8-12 and 29-64 of column 12 and Fig. 1; it is noted that the display device of Fig. 1 has 
different areas where element 63 corresponds to first area for freehand graphic and elements 41- 
60 corresponds to second area where selection of property for the freehand graphic can be made. 
And the position is determined by sensing which area is being touched by the input pen). Both 
Raviv and More are directed to using input pen to create digital graphic information on a display. 
It would have been obvious to one of ordinary skill in the art to modify Raviv by substituting the 
display as taught by More for the display as taught by Raviv to provide more functions in 
creating better digital graphics in a highly portable and interactive information entry, processing, 
storage and display device (lines 42-44 of column 6 of More). 

9. Regarding claims 2 and 3, Raviv discloses a display pointing device comprising: 

The drawing device includes the microprocessor; the microprocessor resides externally of 
the drawing device (lines 7-14 of column 3 and Fig. 1-2; it is clear that the processing circuitry 
includes a processor to process the output from the optical sensor to identify the location of the 
pointing device). 
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10. Regarding claim 5, Raviv does not disclose a display to indicate a property selected from 
the second area. More discloses a portable interactive electro-optic data input/output display 
device utilizing the method (lines 59-68 of column 31 and lines 1-2 of column 32 and Fig. 1; the 
property (text or graph) selected is being indicated by highlighting or displaying on another 
area). Both Raviv and More are directed to using input pen to create digital graphic information 
on-a display^ It wouldhave-been obvious to. one of ordinary skill in the art to modify Raviv by 
substituting the display as taught by More for the display as taught by Raviv to provide more 
functions in creating better digital graphics in a highly portable and interactive information entry, 
processing, storage and display device (lines 42-44 of column 6 of More). 

11. Regarding claim 15, statements presented above, with respect to claim 1 are incorporated 
herein. 

12. Regarding claim 16, Raviv discloses a display pointing device comprising: 

The microprocessor is adapted to assign a time-stamp to the position detected by the 
optical sensor (lines 36-55 of column 5 and lines 30-42 of column 8 and Fig. 13-14; while claim 
recites assigning a time-stamp, it is noted that different patterns sensed by the optical sensor are 
in time sequence to provide moving direction of the pointing device. Thus, it is clear that each 
pattern or position has a time sequence indicated by the processing circuitry (microprocessor)). 

13. Regarding claim 17, Raviv discloses a display pointing device comprising: 

The microprocessor is adapted to determine an order in which the position was detected 
relative to other positions detected by the optical sensor (lines 36-55 of column 5 and lines 30-42 
of column 8 and Fig. 13-14; it is noted that the moving direction of the pointing device is being 
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determining by the order of different regions being detected by the optical sensor. Processing 
circuitry corresponds to the microprocessor). 

14. Regarding claim 18, statements presented above, with respect to claim 1 are incorporated 
herein. Furthermore, Raviv discloses that the position is detected by optical sensor of the input 
pointing device being placed and moved on the surface of the screen (lines 28-55 of column 5 
and-Eig.-12).- ._. _ _ _____ _ .___„__;_ 

15. Regarding claim 19, statements presented above, with respect to claim 16 are 
incorporated herein. 

16. Regarding claim 20, statements presented above, with respect to claim 17 are 
incorporated herein. 

17. Regarding claim 21, Raviv discloses a display pointing device comprising: 
Determining a sub-area of the second area in which the position lies (lines 40-67 of 

column 4 and Fig. 9-10; non-numerical regions can be considered as sub-areas of the second area 
and their positions can be determined by the optical sensor). 

Raviv does not disclose determining a property for the freehand graphic; determining that 
the property for the freehand graphic comprises a property represented by the sub-area. More 
discloses a portable interactive electro-optic data input/output display device utilizing the method 
(lines 58-60 of column 12, lines 59-68 of column 3 1 and lines 1-2 of column 32 and Fig. 1; the 
property (text or graph) of the freeform graphic is being determined when selected by user). 
Both Raviv and More are directed to using input pen to create digital graphic information on a 
display. It would have been obvious to one of ordinary skill in the art to modify Raviv by 
substituting the display as taught by More for the display as taught by Raviv to provide more 
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functions in creating better digital graphics in a highly portable and interactive information entry, 
processing, storage and display device (lines 42-44 of column 6 of More). 

18. Regarding claim 22, Raviv does not disclose if the position lies in the second area, then 
displaying a portion of the freehand graphic drawn after determining the property for the 
freehand graphic in visual accordance with the property. More discloses a portable interactive 
electro-opticjiata input/output display dev ice u tilizing the method (lines 33-41_qf column_35 and 
lines 29-3 1 of column 36 and Fig. 1 ; it is noted that when the property is determined to be graph 
mode, the path of input pen is made visible according to the mode selected). Both Raviv and 
More are directed to using input pen to create digital graphic information on a display. It would 
have been obvious to one of ordinary skill in the art to modify Raviv by substituting the display 
as taught by More for the display as taught by Raviv to provide more functions in creating better 
digital graphics in a highly portable and interactive information entry, processing, storage and 
display device (lines 42-44 of column 6 of More). 

19. Regarding claim 23, Raviv does not disclose if the position lies in the second area, then 
after determining the property for the freehand graphic, applying the property determined to all 
portions of the freehand graphic created until a new property for the freehand graphic is selected. 
More discloses a portable interactive electro-optic data input/output display device utilizing the 
method (lines 33-41 of column 35 and lines 29-3 1 of column 36 and Fig. 1; it is noted that the 
property, text or graph, activates the area for the freehand graphic (element 63 of Fig. 1) to be 
under the mode selected by the user. And until the user touches the sub-area of the property 
again, the mode does not change). Both Raviv and More are directed to using input pen to create 
digital graphic information on a display. It would have been obvious to one of ordinary skill in 
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the art to modify Raviv by substituting the display as taught by More for the display as taught by 
Raviv to provide more functions in creating better digital graphics in a highly portable and 
interactive information entry, processing, storage and display device (lines 42-44 of column 6 of 
More). 

20. Regarding claim 24, Raviv does no disclose if the position lies in the second area, then 
displaying a portion of the fre eha nd graphic dr aw n before determining the property for the 
freehand graphic in visual accordance with the property. More discloses a portable interactive 
electro-optic data input/output display device utilizing the method (lines 33-41 and lines 44-47 of 
column 35 and Fig. 1; it is noted that when graphic mode is chosen, the previously entered text is 
visible to the user). Both Raviv and More are directed to using input pen to create digital graphic 
information on a display. It would have been obvious to one of ordinary skill in the art to modify 
Raviv by substituting the display as taught by More for the display as taught by Raviv to provide 
more functions in creating better digital graphics in a highly portable and interactive information 
entry, processing, storage and display device (lines 42-44 of column 6 of More). 

21. Regarding claims 26-27, statements presented above, with respect to claim 18 are 
incorporated herein. Also see lines 45-49 of column 1 and Fig. 1 of Raviv. Processing circuitry 
having instructions to process the output from the optical sensor in the computer system. 

22. Regarding claim 28, statements presented above, with respect to claim 18 are 
incorporated herein. Furthermore, Raviv does not disclose determining a visual property mapped 
to the position in the selection area; until a new indicator of a position in the selection area is 
received, applying the visual property to portions of the freehand graphic thereafter drawn by 
movement over a drawing area. More discloses a portable interactive electro-optic data 
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input/output display device utilizing the method (lines 33-44 of column 35 and lines 29-31 of 
column 36 and Fig. 1; it is noted that the visual property, text or graph, activates the area (see 
element 63 of Fig. 1) to be under the mode selected by the user. Therefore, the visual property is 
mapped to the position of the selection area. And until the user touches the sub-area of the 
property again, the mode does not change). 

-23.-— Regarding-claim.29,_Raviv do.es not disclosAdisplaying an indication ofthe visual^ _ 
property when it is being applied. More discloses a portable interactive electro-optic data 
input/output display device utilizing the method (lines 67-68 of column 31 and lines 1-2 of 
column 32 and Fig. 1). Both Raviv and More are directed to using input pen to create digital 
graphic information on a display. It would have been obvious to one of ordinary skill in the art 
to modify Raviv by substituting the display as taught by More for the display as taught by Raviv 
to provide more functions in creating better digital graphics in a highly portable and interactive 
information entry, processing, storage and display device (lines 42-44 of column 6 of More). 

24. Regarding claim 30, statements presented above, with respect to claim 28 are 
incorporated herein. Also see lines 45-49 of column 1 and Fig. 1 of Raviv. Processing circuitry 
having instructions to process the output from the optical sensor in the computer system, 

25. Claim 7 is rejected under 35 U.S.C. 103(a) as being unpatentable over Raviv et al. (US 
6,061,052; refer to as Raviv herein). 

26. Regarding claim 7, Raviv does not disclose that the second area is physically separated 
from the first area (assuming the claim means the two are not at all connected to one another). 
However, by having the second area physically separated from the first area does not provide 
additional function to the system disclosed by Raviv. Thus, it would have been a matter of 
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design choice. Also, it would appear that the claim is broad enough to be read as just having two 
different, non-overlapping areas. If so, the claim could be read on different numerical regions of 
Fig. 9-10, for example. 

27. Claims 8-10 and 34 are rejected under 35 U.S. C. 103(a) as being unpatentable over Raviv 
et al. (US 6,061,052; refer to as Raviv herein), as applied to claims 6 and 31 above, and further in 

-view-of More-et al.(US 5,194,852;„refer_to as Moxe herein). _ _ _ i_ _ 

28. Regarding claims 8-10, Raviv discloses a display pointing device comprising: 

The second area includes a plurality of visually distinct sub-areas (Fig. 9-10; since areas 
are not specifically defined, the example of Fig. 9-10 can be considered as 2 areas where each 
area includes a group of sub-areas. For example, all the numerical symbols can be considered as 
first area and the rest of the sub-areas can be considered as second area. And they are all visually 
distinct sub- areas). 

Raviv does not disclose at least one of the sub-areas comprises a label representing a 
property for a freeform graphic and at least one of the sub-areas comprises an indication of a 
property for a freeform graphic. More discloses a portable interactive electro-optic data 
input/output display device utilizing the method (lines 58-60 of column 12, lines 59-68 of 
column 31 and lines 1-2 of column 32 and Fig. 1; the property (text or graph) of the freeform 
graphic selected is being indicated by highlighting (label) or displaying on another area). Both 
Raviv and More are directed to using input pen to create digital graphic information on a display. 
It would have been obvious to one of ordinary skill in the art to modify Raviv by substituting the 
display as taught by More for the display as taught by Raviv to provide more functions in 
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creating better digital graphics in a highly portable and interactive information entry, processing, 
storage and display device (lines 42-44 of column 6 of More). 

29. Regarding claim 34, Raviv does not disclose the specific information comprises an 
ASCII code corresponding to the visual indicator. More discloses a portable interactive electro- 
optic data input/output display device utilizing the method (lines 22-28 of abstract, lines 67-68 of 
column 31 and lines - l -23~of column 32 and Fig: -1 ; it-is noted-that-the message._(text mode) 
displayed to indicate selected property is in ASCII format as the system suggested). 

30. Claims 36 and 40 are rejected under 35 U.S.C. 103(a) as being unpatentable over Raviv 
et al. (US 6,061,052; refer to as Raviv herein), as applied to claims 6 and 31 above, and further in 
view of Sekendur (US 5,852,434). 

Regarding claim 36, Raviv does not disclose position coding pattern is printed on said 
surface of said base. Sekendur discloses a absolute optical position determination utilizing the 
method (lines 16-22 and 57-60 of column 3 and lines 30-3 1 of column 7). Both Raviv and 
Sekendur are directed to method of using optical sensor to detect coding pattern for determining 
position of the pointing device such as a stylus. It would have been obvious to one of ordinary 
skill in the art to modify Raviv by substituting the surface as taught by Sekendur for the surface 
screen as taught by Raviv to provide the ability to utilize the function of detecting position 
coding pattern using optical sensor on a more flexible surface, such as paper that is easy to work 
on, instead having a complex, large, heavy, cumbersome and expensive surface interface, such as 
one disclosed by Raviv. 

3 1 . Regarding claim 40, statements presented above, with respect to claim 36 are 
incorporated herein. 
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32. Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over Raviv et al. (US 
6,061,052; refer to as Raviv herein) and More et al. (US 5,582,434; refer to as More herein) as 
applied to claim 1 above, and further in view of Allard et al. (US 5,815,142; refer to as Allard 
herein). 

33. Regarding claim 4, the combination of Raviv and More does not disclose a cellular 
-phone, and-wherein thexellular phone includes the microprocessor. Allard teaches a apparatus^ 

and method for making text on a display screen in a personal communications device such as a 
cellular phone utilizing the method (lines 40-42 of column 1 and 43-47 of column 6 and Fig. 1- 
4). Both Raviv and Allard are directed to method of using input pointing device such as stylus to 
operate a graphical user interface. It would have been obvious to one of ordinary skill in the art 
to modify Raviv by substitute the cellular telephone as taught by Allard for the computer system 
as taught by Raviv to provide the ability to utilize the function of detecting position coding 
pattern using optical sensor on a more portable device such as a cellular device. Thus, an 
efficient way to extract and use relevant information from the display screen of a cellular phone 
device can be achieved (lines 40-42 and 57-60 of column 1, Allard). 

34. Claims 1 1-14 are rejected under 35 U.S.C. 103(a) as being unpatentable over Raviv et al. 
(US 6,061,052; refer to as Raviv herein) as applied to claim 6 above, and further in view of 
Weinmann et al. ("Photoshop 5.5 for Windows & Macintosh"; refer to as Weinmann herein). 

35. Regarding claim 1 1-14, Raviv discloses a display pointing device comprising: 

The second area includes a plurality of visually distinct sub-areas (Fig. 9-10; since areas 
are not specifically defined, the example of Fig. 9-10 can be considered as 2 areas where each 
area includes a group of sub-areas. For example, all the numerical symbols can be considered as 
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first area and the rest of the sub-areas can be considered as second area. And they are all visually 
distinct sub-areas). 

Raviv does not disclose at least one of the sub-areas comprises an indication of a color, a 
line thickness, a type of line and a layer for deposition for a freeform graphic. However, this is 
know in the art taught by Weinmann. Weinmann teaches a method of operating Photoshop, an 
-image-editing.to.o.l comprising:. _ _ _ 

Indication of a color (line 1 of paragraph 1 of page 3 and 2 nd Figure of page 3); 

Indication of a line thickness (1 st Figure of page 5; it is noted that by selecting different 
size of dots indicated changes the line thickness); 

Indication of a type of line (page 7-8; it is noted that by select different properties for a 
specific line size, the type of line is changed); 

Indication of a layer for deposition (section 'layers palette' of page 5-6 and 1 st Figure of 
Page 6); 

It is further noted that Photoshop provides a freeform graphic input area and different 
palettes (1 st Figure of Page 1). And the palettes for indicating a color, a line thickness, a type of 
line and a layer for deposition can be displayed by user (section 'the palettes' of page 2). 

It would have been obvious to one of ordinary skill in the art at the time of invention to 
utilize the teaching of Weinmann to provide the functions of Photoshop to a user to create a 
freeform graphic in Raviv because Raviv already shows the capability of creating freeform 
graphic image and the cited functions of Weinmann allows for more customization of the 
drawing. 
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36. Claim 25 is rejected under 35 U.S.C. 103(a) as being unpatentable over Raviv et al. (US 
6,061,052; refer to as Raviv herein) and More et al. (US 5,194,852; refer to as More herein) as 
applied to claim 18 above, and further in view of Weinmann et al. ("Photoshop 5.5 for Windows 
& Macintosh"; refer to as Weinmann herein). 

37. Regarding claim 25, statements presented above, with respect to claims 1 1-14 are 
incorporated herein. " 

38. Claims 35 and 37-39 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Raviv et al. (US 6,061,052; refer to as Raviv herein) and More et al. (US 5,582,434; refer to as 
More herein) as applied to claims 1, 15, 18 and 28 above, and further in view of Sekendur (US 
5,852,434). 

39. Regarding claims 35 and 37-39, statements presented above, with respect to claim 36 are 
incorporated herein. 

Response to Arguments 

40. Applicant's arguments, see pages 10-16, filed January 16, 2004, with respect to the 
rejection(s) of claim(s) 1-40 under 35 USC 103 have been fully considered and are persuasive. 
Therefore, the rejection has been withdrawn. However, upon further consideration, a new 
ground(s) of rejection is made in view of Raviv et al. (US 6,061,052). 

Conclusion 

41 . The prior art made of record and not relied upon is considered pertinent to applicants 
disclosure. 

Ogawa(US 5,572,251); 
Ogawa et al. (US 5,502,568); 
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Katoetal. (US 5,963,199). 



Inquiry 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Po-Wei (Dennis) Chen whose telephone number is (703) 305- 
8365. The examiner can normally be reached on 9am-5pm. 

" - — If attempts-to reaeh-the examiner by-telephone, are unsuccessfW, the examiner's 
supervisor, Matthew C Bella can be reached on (703) 308-6829. The fax phone number for the 
organization where this application or proceeding is assigned is (703) 872-9306. 

Any inquiry of a general nature or relating to the status of this application or proceeding 
should be directed to the receptionist whose telephone number is (703) 305-3900. 



Po-Wei (Dennis) Chen 

Examiner 

Art Unit 2676 



Po-Wei (Dennis) Chen 
January 28, 2004 
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SUPERVISORY PATENT EXAMINER 
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